Electronic device comprising image sensor for identifying an operation setting and an external environmental condition and method of operation thereof

ABSTRACT

An electronic device is provided and includes an image sensor including a plurality of unit pixels including a first unit pixel and a second unit pixel, the first unit pixel including a first micro-lens, a first color filter disposed under the first micro-lens, and a first photodiode-array disposed under the first color filter and including a plurality of photodiodes arranged in a same number of columns and rows as each other, and the second unit pixel including a second micro-lens, a second color filter disposed under the second micro-lens and having a different color from that of the first color filter, and a second photodiode-array disposed under the second color filter and including a plurality of photodiodes arranged in a same number of columns and rows as each other; and a processor operatively coupled with the image sensor, wherein the processor is configured to identify a mode corresponding to an auto-focus function; if the mode is identified as a first mode, perform the auto-focus function based at least in part on comparing a first combined signal generated by combining signals obtained from a first column of the first photodiode-array with a second combined signal generated by combining signals obtained from a second column of the first photodiode-array; if the mode is identified as a second mode different from the first mode, perform the auto-focus function based at least in part on comparing the first combined signal with the second combined signal and comparing a third combined signal generated by combining signals obtained from a first row of the first photodiode-array with a fourth combined signal generated by combining signals obtained from a second row of the first photodiode-array; and generate an image signal based at least in part on signals obtained from the first unit pixel and the second unit pixel while the auto-focus function is performed according to a one of the first mode and the second mode.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application is a Continuation application of U.S. application Ser.No. 17/130,778, filed on Dec. 22, 2020, in the United States Patent andTrademark Office, which is based on and claims priority under 35 U.S.C.§ 119 to Korean Patent Application No. 10-2019-0172916, filed on Dec.23, 2019, in the Korean Intellectual Property Office, the disclosures ofwhich are incorporated by reference herein their entireties.

BACKGROUND 1. Field

The disclosure relates to an electronic device including an image sensorand a method of operating the electronic device.

2. Description of Related Art

An image sensor is a device that converts an optical image into anelectrical signal. With the development of computer and communicationindustries, there is an increasing demand on a high-performance imagesensor in various electronic devices such as a digital camera, acamcorder, a personal communication system (PCS), a game console, asecurity camera, a medical micro camera, and a robot.

The image sensor may include at least one micro-lens. At least one pixelmay be disposed under the micro-lens.

In an image sensor including a unit pixel in which a plurality of pixelsare disposed under a single micro-lens, it may be difficult to generatean image with a high resolution, using left and right images.

SUMMARY

The present disclosure has been made to address the above-mentionedproblems and disadvantages, and to provide at least the advantagesdescribed below. In accordance with an aspect of the disclosure, anelectronic device includes an image sensor including a plurality of unitpixels including a first unit pixel and a second unit pixel, the firstunit pixel including a first micro-lens, a first color filter disposedunder the first micro-lens, and a first photodiode-array disposed underthe first color filter and including a plurality of photodiodes arrangedin a same number of columns and rows as each other, and the second unitpixel including a second micro-lens, a second color filter disposedunder the second micro-lens and having a different color from that ofthe first color filter, and a second photodiode-array disposed under thesecond color filter and including a plurality of photodiodes arranged ina same number of columns and rows as each other; and a processoroperatively coupled with the image sensor, wherein the processor isconfigured to identify a mode corresponding to an auto-focus function;if the mode is identified as a first mode, perform the auto-focusfunction based at least in part on comparing a first combined signalgenerated by combining signals obtained from a first column of the firstphotodiode-array with a second combined signal generated by combiningsignals obtained from a second column of the first photodiode-array; ifthe mode is identified as a second mode different from the first mode,perform the auto-focus function based at least in part on comparing thefirst combined signal with the second combined signal and comparing athird combined signal generated by combining signals obtained from afirst row of the first photodiode-array with a fourth combined signalgenerated by combining signals obtained from a second row of the firstphotodiode-array; and generate an image signal based at least in part onsignals obtained from the first unit pixel and the second unit pixelwhile the auto-focus function is performed according to a one of thefirst mode and the second mode.

In accordance with another aspect of the disclosure, an electronicdevice includes a memory; a display; a camera module including an imagesensor, the image sensor including a plurality of unit pixels includinga first unit pixel and a second unit pixel, the first unit pixelincluding a first micro-lens, a first color filter disposed under thefirst micro-lens, and a first photodiode-array disposed under the firstcolor filter and including a plurality of photodiodes arranged in a samenumber of columns and rows as each other, and the second unit pixelincluding a second micro-lens, a second color filter disposed under thesecond micro-lens and having a different color from that of the firstcolor filter, and a second photodiode-array disposed under the secondcolor filter and including a plurality of photodiodes arranged in a samenumber of columns and rows as each other; and a processor operativelycoupled with the image sensor, wherein the processor is configured toidentify a mode corresponding to an auto-focus function for the cameramodule; if the mode is identified as a first mode, perform theauto-focus function based at least in part on comparing a first combinedsignal generated by combining signals obtained a first column of thefirst photodiode-array with a second combined signal generated bycombining signals obtained from a second column of the firstphotodiode-array; if the mode is identified as a second mode differentfrom the first mode, perform the auto-focus function based at least inpart on comparing the first combined signal with the second combinedsignal and comparing a third combined signal generated by combiningsignals obtained from a first row of the first photodiode-array with afourth combined signal generated by combining signals obtained from asecond row of the first photodiode-array; and display, via the display,an image generated based at least in part on signals obtained from thefirst unit pixel and the second unit pixel while the auto-focus functionis performed according to a one of the first mode and the second mode.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features, and advantages of certainembodiments of the disclosure will be more apparent from the followingdescription taken in conjunction with the accompanying drawings, inwhich:

FIG. 1 is a block diagram of an electronic device in a networkenvironment 100, according to an embodiment;

FIG. 2 is a block diagram illustrating a camera module, according to anembodiment;

FIG. 3 is a diagram illustrating an image sensor, according to anembodiment;

FIG. 4 is a diagram for describing unit pixels, according to anembodiment;

FIG. 5 is a cross-sectional view illustrating a cross-section of asingle unit pixel of FIG. 4 taken along line z-z′, according to anembodiment;

FIG. 6 is a flowchart for describing an operation of an image sensor,according to an embodiment;

FIG. 7 is a block diagram illustrating pieces of hardware included in animage sensor, according to an embodiment;

FIG. 8 is a diagram illustrating unit pixels included in an imagesensor, according to an embodiment;

FIG. 9 is a diagram illustrating an example of forming a Bayer-patternedimage based on signals of an image sensor, according to an embodiment;

FIG. 10 is a diagram illustrating two cases of outputting signals of animage sensor, according to an embodiment;

FIG. 11 is a diagram illustrating a method of calculating a disparity ofan image sensor, according to an embodiment; and

FIG. 12 is a diagram illustrating unit pixels included in a pixel arrayof an image sensor, according to an embodiment.

DETAILED DESCRIPTION

An aspect of the disclosure is to provide an image sensor capable ofimplementing a high-resolution image.

Hereinafter, various embodiments of the disclosure will be describedwith reference to accompanying drawings. However, it should beunderstood that this is not intended to limit the disclosure to specificimplementation forms and includes various modifications, equivalents,and/or alternatives of embodiments of the disclosure.

FIG. 1 is a diagram illustrating an electronic device in a networkenvironment according to various embodiments. Referring to FIG. 1 , anelectronic device 101 may communicate with an electronic device 102through a first network 198 (e.g., a short-range wireless communicationnetwork) or may communicate with an electronic device 104 or a server108 through a second network 199 (e.g., a long-distance wirelesscommunication network) in a network environment 100. According to anembodiment, the electronic device 101 may communicate with theelectronic device 104 through the server 108. According to anembodiment, the electronic device 101 may include a processor 120, amemory 130, an input device 150, a sound output device 155, a displaydevice 160, an audio module 170, a sensor module 176, an interface 177,a haptic module 179, a camera module 180, a power management module 188,a battery 189, a communication module 190, a subscriber identificationmodule 196, or an antenna module 197. According to some embodiments, atleast one among components of the electronic device 101 may be omittedor one or more other components may be added to the electronic device101. According to some embodiments, some of the above components may beimplemented with one integrated circuit. For example, the sensor module176 (e.g., a fingerprint sensor, an iris sensor, or an illuminancesensor) may be embedded in the display device 160 (e.g., a display).

The processor 120 may execute, for example, software (e.g., a program140) to control at least one of other components (e.g., a hardware orsoftware component) of the electronic device 101 connected to theprocessor 120 and may process or compute a variety of data. According toan embodiment, as a part of data processing or operation, the processor120 may load a command set or data, which is received from othercomponents (e.g., the sensor module 176 or the communication module190), into a volatile memory 132, may process the command or data loadedinto the volatile memory 132, and may store result data into anonvolatile memory 134. According to an embodiment, the processor 120may include a main processor 121 (e.g., a central processing unit or anapplication processor) and an auxiliary processor 123 (e.g., a graphicprocessing device, an image signal processor, a sensor hub processor, ora communication processor), which operates independently from the mainprocessor 121 or with the main processor 121. Additionally oralternatively, the auxiliary processor 123 may use less power than themain processor 121, or is specified to a designated function. Theauxiliary processor 123 may be implemented separately from the mainprocessor 121 or as a part thereof.

The auxiliary processor 123 may control, for example, at least some offunctions or states associated with at least one component (e.g., thedisplay device 160, the sensor module 176, or the communication module190) among the components of the electronic device 101 instead of themain processor 121 while the main processor 121 is in an inactive (e.g.,sleep) state or together with the main processor 121 while the mainprocessor 121 is in an active (e.g., an application execution) state.According to an embodiment, the auxiliary processor 123 (e.g., the imagesignal processor or the communication processor) may be implemented as apart of another component (e.g., the camera module 180 or thecommunication module 190) that is functionally related to the auxiliaryprocessor 123.

The memory 130 may store a variety of data used by at least onecomponent (e.g., the processor 120 or the sensor module 176) of theelectronic device 101. For example, data may include software (e.g., theprogram 140) and input data or output data with respect to commandsassociated with the software. The memory 130 may include the volatilememory 132 or the nonvolatile memory 134.

The program 140 may be stored in the memory 130 as software and mayinclude, for example, an operating system 142, a middleware 144, or anapplication 146.

The input device 150 may receive a command or data, which is used for acomponent (e.g., the processor 120) of the electronic device 101, froman outside (e.g., a user) of the electronic device 101. The input device150 may include, for example, a microphone, a mouse, a keyboard, or adigital pen (e.g., a stylus pen).

The sound output device 155 may output a sound signal to the outside ofthe electronic device 101. The sound output device 155 may include, forexample, a speaker or a receiver. The speaker may be used for generalpurposes, such as multimedia play or recordings play, and the receivermay be used for receiving calls. According to an embodiment, thereceiver and the speaker may be either integrally or separatelyimplemented.

The display device 160 may visually provide information to the outside(e.g., the user) of the electronic device 101. For example, the displaydevice 160 may include a display, a hologram device, or a projector anda control circuit for controlling a corresponding device. According toan embodiment, the display device 160 may include a touch circuitryconfigured to sense the touch or a sensor circuit (e.g., a pressuresensor) for measuring an intensity of pressure on the touch.

The audio module 170 may convert a sound and an electrical signal indual directions. According to an embodiment, the audio module 170 mayobtain the sound through the input device 150 or may output the soundthrough the sound output device 155 or an external electronic device(e.g., the electronic device 102 (e.g., a speaker or a headphone))directly or wirelessly connected to the electronic device 101.

The sensor module 176 may generate an electrical signal or a data valuecorresponding to an operating state (e.g., power or temperature) insideor an environmental state (e.g., a user state) outside the electronicdevice 101. According to an embodiment, the sensor module 176 mayinclude, for example, a gesture sensor, a gyro sensor, a barometricpressure sensor, a magnetic sensor, an acceleration sensor, a gripsensor, a proximity sensor, a color sensor, an infrared sensor, abiometric sensor, a temperature sensor, a humidity sensor, or anilluminance sensor.

The interface 177 may support one or more designated protocols to allowthe electronic device 101 to connect directly or wirelessly to theexternal electronic device (e.g., the electronic device 102). Accordingto an embodiment, the interface 177 may include, for example, an HDMI(high-definition multimedia interface), a USB (universal serial bus)interface, an SD card interface, or an audio interface.

A connecting terminal 178 may include a connector that physicallyconnects the electronic device 101 to the external electronic device(e.g., the electronic device 102). According to an embodiment, theconnecting terminal 178 may include, for example, an HDMI connector, aUSB connector, an SD card connector, or an audio connector (e.g., aheadphone connector).

The haptic module 179 may convert an electrical signal to a mechanicalstimulation (e.g., vibration or movement) or an electrical stimulationperceived by the user through tactile or kinesthetic sensations.According to an embodiment, the haptic module 179 may include, forexample, a motor, a piezoelectric element, or an electric stimulator.

The camera module 180 may shoot a still image or a video image.According to an embodiment, the camera module 180 may include, forexample, at least one or more lenses, image sensors, image signalprocessors, or flashes.

The power management module 188 may manage power supplied to theelectronic device 101. According to an embodiment, the power managementmodule 188 may be implemented as at least a part of a power managementintegrated circuit (PMIC).

The battery 189 may supply power to at least one component of theelectronic device 101. According to an embodiment, the battery 189 mayinclude, for example, a non-rechargeable (primary) battery, arechargeable (secondary) battery, or a fuel cell.

The communication module 190 may establish a direct (e.g., wired) orwireless communication channel between the electronic device 101 and theexternal electronic device (e.g., the electronic device 102, theelectronic device 104, or the server 108) and support communicationexecution through the established communication channel. Thecommunication module 190 may include at least one communicationprocessor operating independently from the processor 120 (e.g., theapplication processor) and supporting the direct (e.g., wired)communication or the wireless communication. According to an embodiment,the communication module 190 may include a wireless communication module192 (e.g., a cellular communication module, a short-range wirelesscommunication module, or a GNSS (global navigation satellite system)communication module) or a wired communication module 194 (e.g., an LAN(local area network) communication module or a power line communicationmodule). The corresponding communication module among the abovecommunication modules may communicate with the external electronicdevice 104 through the first network 198 (e.g., the short-rangecommunication network such as a Bluetooth, a WiFi direct, or an IrDA(infrared data association)) or the second network 199 (e.g., thelong-distance wireless communication network such as a cellular network,an internet, or a computer network (e.g., LAN or WAN)). Theabove-mentioned various communication modules may be implemented intoone component (e.g., a single chip) or into separate components (e.g.,chips), respectively. The wireless communication module 192 may identifyand authenticate the electronic device 101 using user information (e.g.,international mobile subscriber identity (IMSI)) stored in thesubscriber identification module 196 in the communication network, suchas the first network 198 or the second network 199.

The antenna module 197 may transmit or receive a signal or power to orfrom the outside (e.g., the external electronic device) of theelectronic device 101. According to an embodiment, the antenna module197 may include an antenna including a radiating element composed of aconductive material or a conductive pattern formed in or on a substrate(e.g., PCB). According to an embodiment, the antenna module 197 mayinclude a plurality of antennas. In such a case, at least one antennaappropriate for a communication scheme used in the communicationnetwork, such as the first network 198 or the second network 199, may beselected, for example, by the communication module 190 (e.g., thewireless communication module 192) from the plurality of antennas. Thesignal or the power may then be transmitted or received between thecommunication module 190 and the external electronic device via theselected at least one antenna. According to an embodiment, anothercomponent (e.g., a radio frequency integrated circuit (RFIC)) other thanthe radiating element may be additionally formed as part of the antennamodule 197.

At least some components among the components may be connected to eachother through a communication method (e.g., a bus, a GPIO (generalpurpose input and output), an SPI (serial peripheral interface), or anMIPI (mobile industry processor interface)) used between peripheraldevices to exchange signals (e.g., a command or data) with each other.

According to an embodiment, the command or data may be transmitted orreceived between the electronic device 101 and the external electronicdevice 104 through the server 108 connected to the second network 199.Each of the electronic devices 102 and 104 may be the same or differenttypes as or from the electronic device 101. According to an embodiment,all or some of the operations performed by the electronic device 101 maybe performed by one or more external electronic devices among theexternal electronic devices 102, 104, or 108. For example, when theelectronic device 101 performs some functions or services automaticallyor by request from a user or another device, the electronic device 101may request one or more external electronic devices to perform at leastsome of the functions related to the functions or services, in additionto or instead of performing the functions or services by itself. The oneor more external electronic devices receiving the request may carry outat least a part of the requested function or service or the additionalfunction or service associated with the request and transmit theexecution result to the electronic device 101. The electronic device 101may provide the result as is or after additional processing as at leasta part of the response to the request. To this end, for example, a cloudcomputing, distributed computing, or client-server computing technologymay be used.

FIG. 2 is a block diagram 200 illustrating the camera module 180according to various embodiments. Referring to FIG. 2 , the cameramodule 180 may include a lens assembly 210, a flash 220, an image sensor230, an image stabilizer 240, a memory 250 (e.g., buffer memory), or animage signal processor 260. The lens assembly 210 may collect lightemitted from an object whose image is to be taken. The lens assembly 210may include one or more lenses. According to an embodiment, the cameramodule 180 may include a plurality of lens assemblies 210. In such acase, the camera module 180 may form, for example, a dual camera, a360-degree camera, or a spherical camera. Some of the plurality of lensassemblies 210 may have the same lens attribute (e.g., view angle, focallength, auto-focusing, f number, or optical zoom), or at least one lensassembly may have one or more lens attributes different from those ofanother lens assembly. The lens assembly 210 may include, for example, awide-angle lens or a telephoto lens.

The flash 220 may emit light that is used to reinforce light emitted orreflected from an object. According to an embodiment, the flash 220 mayinclude one or more light emitting diodes (LEDs) (e.g., a red-green-blue(RGB) LED, a white LED, an infrared (IR) LED, or an ultraviolet (UV)LED) or a xenon lamp. The image sensor 230 may obtain an imagecorresponding to an object by converting light emitted or reflected fromthe object and transmitted via the lens assembly 210 into an electricalsignal. According to an embodiment, the image sensor 230 may include oneselected from image sensors having different attributes, such as a RGBsensor, a black-and-white (BW) sensor, an IR sensor, or a UV sensor, aplurality of image sensors having the same attribute, or a plurality ofimage sensors having different attributes. Each image sensor included inthe image sensor 230 may be implemented using, for example, a chargedcoupled device (CCD) sensor or a complementary metal oxide semiconductor(CMOS) sensor.

The image stabilizer 240 may move the image sensor 230 or at least onelens included in the lens assembly 210 in a particular direction, orcontrol an operational attribute (e.g., adjust the read-out timing) ofthe image sensor 230 in response to the movement of the camera module180 or the electronic device 101 including the camera module 180. Thisallows compensating for at least part of a negative effect (e.g., imageblurring) by the movement on an image being captured. According to anembodiment, the image stabilizer 240 may sense such a movement by thecamera module 180 or the electronic device 101 using a gyro sensor (notshown) or an acceleration sensor (not shown) disposed inside or outsidethe camera module 180. According to an embodiment, the image stabilizer240 may be implemented, for example, as an optical image stabilizer. Thememory 250 may store, at least temporarily, at least part of an imageobtained via the image sensor 230 for a subsequent image processingtask. For example, when the image capturing is delayed due to shutterlag or multiple images are quickly captured, a raw image obtained (e.g.,a Bayer-patterned image, a high-resolution image) may be stored in thememory 250, and its corresponding copy image (e.g., a low-resolutionimage) may be previewed via the display device 160. Thereafter, when aspecified condition is met (e.g., by a user's input or system command),at least part of the raw image stored in the memory 250 may be obtainedand processed, for example, by the image signal processor 260. Accordingto an embodiment, the memory 250 may be configured as at least part ofthe memory 130 or as a separate memory that is operated independentlyfrom the memory 130.

The image signal processor 260 may perform one or more image processingon an image obtained via the image sensor 230 or an image stored in thememory 250. The one or more image processing may include, for example,depth map generation, three-dimensional (3D) modeling, panoramageneration, feature point extraction, image synthesizing, or imagecompensation (e.g., noise reduction, resolution adjustment, brightnessadjustment, blurring, sharpening, or softening). Additionally oralternatively, the image signal processor 260 may control (e.g.,exposure time control or read-out timing control) at least one (e.g.,the image sensor 230) of the components included in the camera module180. An image processed by the image signal processor 260 may be storedback in the memory 250 for further processing, or may be provided to anexternal component (e.g., the memory 130, the display device 160, theelectronic device 102, the electronic device 104, or the server 108)outside the camera module 180. According to an embodiment, the imagesignal processor 260 may be configured as at least part of the processor120, or as a separate processor that is operated independently from theprocessor 120. When the image signal processor 260 is configured as aseparate processor from the processor 120, at least one image processedby the image signal processor 260 may be displayed, by the processor120, via the display device 160 as it is or after being furtherprocessed.

According to an embodiment, the electronic device 101 may include aplurality of camera modules 180 having different attributes orfunctions. In such a case, at least one of the plurality of cameramodules 180 may form, for example, a wide-angle camera and at leastanother of the plurality of camera modules 180 may form a telephotocamera. Similarly, at least one of the plurality of camera modules 180may form, for example, a front camera and at least another of theplurality of camera modules 180 may form a rear camera.

Hereinafter, an electronic device will be described with reference toFIGS. 3, 4 , and 5. For clarity, contents the same as theabove-described details are briefly described or omitted.

FIG. 3 is a diagram illustrating an image sensor 300, according to anembodiment. FIG. 4 is a diagram 400 for describing unit pixels,according to an embodiment. FIG. 5 is a cross-sectional view 500illustrating a cross-section of a single unit pixel of FIG. 4 takenalong line z-z′, according to an embodiment.

Referring to FIG. 3 , the image sensor 300 includes a pixel array 332, afirst scan circuit 331, a second scan circuit 333, and a read circuit335.

The pixel array 332 may include a plurality of pixels units including afirst pixel unit 310, a second pixel unit 311, a third pixel unit, 312,a fourth pixel unit 320, a fifth pixel unit, and a sixth pixel unit 322.Additional pixel units may also be included in the plurality of pixelunits. The plurality of unit pixels may be arranged along an X direction(e.g., a row direction) and a Y direction (e.g., a column direction).

Each of a plurality of unit pixels may include one micro-lens. Forexample, the first unit pixel 310 may include a first micro-lens 305and/or the second unit pixel 311 may include a second micro-lens 306.

Each of the plurality of unit pixels may include at least one photodiode(e.g., a first photodiode 301, a second photodiode 302, a thirdphotodiode 303, and a fourth photodiode 304). The number of photodiodesincluded in each of the plurality of unit pixels may be based on thenumber of pixels included in each of the plurality of unit pixels.

The first scan circuit 331 and the second scan circuit 333 may detectsignals for each of the plurality of pixels units including the firstpixel unit 310, the second pixel unit 311, the third pixel unit, 312,the fourth pixel unit 320, the fifth pixel unit, and the sixth pixelunit 322 under the control of a processor. The first scan circuit 331may detect a signal for each of the plurality of pixels units includingthe first pixel unit 310, the second pixel unit 311, the third pixelunit, 312, the fourth pixel unit 320, the fifth pixel unit, and thesixth pixel unit 322 in the Y direction. The second scan circuit 333 maydetect a signal for each of the plurality of pixels units including thefirst pixel unit 310, the second pixel unit 311, the third pixel unit,312, the fourth pixel unit 320, the fifth pixel unit, and the sixthpixel unit 322 in the X direction. The read circuit 335 may read thedetected signal.

Each of the plurality of pixels units including the first pixel unit310, the second pixel unit 311, the third pixel unit, 312, the fourthpixel unit 320, the fifth pixel unit, and the sixth pixel unit 322 mayinclude n×n pixels (where “n” is a natural number greater than 1). Thefirst unit pixel 310 may include n×n pixels overlapping with the firstmicro-lens 305 and/or the second unit pixel 311 may include n×n pixelsoverlapping with the second micro-lens 306. Each of the n×n pixels maycorrespond to a single photodiode.

Each of the plurality of pixels including the first pixel unit 310, thesecond pixel unit 311, the third pixel unit, 312, the fourth pixel unit320, the fifth pixel unit, and the sixth pixel unit 322 may include asingle micro-lens, a plurality of photodiodes, and a color filter (e.g.,green) of one color.

Hereinafter, unit pixels included in the pixel array 332 of the imagesensor 300 of FIG. 3 will be described in detail with reference to FIGS.4 and 5 .

Referring to FIG. 4 , each of a plurality of unit pixels include 2×2photodiodes. For example, the first unit pixel 310 may include the firstphotodiode 301, the second photodiode 302, the third photodiode 303, andthe fourth photodiode 304, which are arranged to overlap with the firstmicro-lens 305. The first photodiode 301 and the third photodiode 303may be arranged along the first row. The second photodiode 302 and thefourth photodiode 304 may be arranged along the second row. The firstphotodiode 301 and the second photodiode 302 may be arranged along thefirst column. The third photodiode 303 and the fourth photodiode 304 maybe arranged along the second column. Each of the first photodiode 301,the second photodiode 302, the third photodiode 303, and the fourthphotodiode 304 may correspond to a single pixel.

The first unit pixel 310 may include one micro-lens 305, the firstphotodiode 301, the second photodiode 302, the third photodiode 303, thefourth photodiode 304, and a green (G) color filter. The second unitpixel 311 may have the same structure as the first unit pixel 310, andthus the description thereof will be omitted. However, the color of thecolor filter included in each of the unit pixels may be green (G), andmay also be different from one another, such as red (R), or blue (B).

Referring to FIG. 5 , in the first unit pixel 310, the first micro-lens305, the first photodiode 301 and the second photodiodes 302 may bedisposed to face each other with a color filter 501 interposedtherebetween. The light incident on the image sensor may be condensedthrough the first micro-lens 305 and may be incident on differentphotodiodes. The signal for the light incident on each photodiode may bedetected by the first scan circuit 331 or the second scan circuit 333.

Hereinafter, the operation of an electronic device according to anembodiment will be described with reference to FIGS. 6, 7, 8, and 9 .For clarity, contents which are the same as the above-described detailsare briefly described or omitted.

Hereinafter, it is assumed that the image sensor 300 of FIG. 3 performsthe process of FIG. 6 . The operation described as being performed bythe image sensor 300 may be performed by a synthetic signal forming unit701, a disparity calculation unit 702, and/or a remosaic processing unit703 included in the image sensor 300.

FIG. 6 is a flowchart 600 for describing an operation of an image sensor300, according to an embodiment. FIG. 7 is a block diagram 700illustrating pieces of hardware included in an image sensor 300,according to an embodiment. FIG. 8 is a diagram 800 illustrating unitpixels included in an image sensor 300, according to an embodiment. FIG.9 is a diagram 900 illustrating an example of forming a Bayer-patternedimage based on signals of an image sensor, according to an embodiment.

Referring to FIG. 6 , in step 610, an image sensor identifies cameraoperation settings and/or external environmental conditions.

The camera operation settings may indicate which of a preview mode, aphoto mode, and a video mode the mode of a camera module 180 included inan electronic device 101 corresponds to. The preview mode may be a modein which a screen captured by the image sensor is provided as a previewto a user when the camera module does not perform photo shooting orvideo shooting. The photo mode may be a mode in which the camera moduletakes a photo. The video mode may be a mode in which the camera modulecaptures a video.

The external environmental conditions may indicate to which of highilluminance and low illuminance the external environment of theelectronic device corresponds. The high illuminance may indicate that abrightness value (BV) corresponding to lux is not less than a specificthreshold value. The low illuminance may indicate that the BV is lessthan the specific threshold value.

The image sensor may not directly identify camera operation settings andexternal environmental conditions, but may receive the informationidentified by a processor 120 from the processor of the electronicdevice.

In step 620, the image sensor determines the operation of the imagesensor and the signal to be output, based on the camera operationsettings and/or external environmental conditions identified in step610. Hereinafter, the operation and output signals of the image sensoraccording to the identified camera operation settings and/or externalenvironmental conditions will be described in detail with reference toTable 1, below.

TABLE 1 First external environmental condition Second externalenvironmental condition Operation of Operation of image sensor AFinformation Output signal image sensor AF information Output signalFirst camera First to fourth First AF information, First output First tofourth First AF information, Second output operation vertical areasecond AF information signal pixel signal, second AF information, signalsetting signals Fifth to eighth third AF information, pixel signalfourth AF information Second camera First to fourth First AFinformation, Third output First to fourth First AF information, Firstoutput operation pixel signal, second AF information, signal verticalarea second AF information signal setting Fifth to eighth third AFinformation, signals pixel signal fourth AF information Third cameraFirst to fourth — Third output First unit First unit operation pixelsignal, signal pixel signal, pixel signal, setting Fifth to eighthSecond unit Second unit pixel signal pixel signal pixel signal

In Table 1, the first camera operation setting, the second cameraoperation setting, and the third camera operation setting may bedifferent modes of the camera module 180, respectively. For example, thefirst camera operation setting may be in a preview mode; the secondcamera operation setting may be in a video mode; the third cameraoperation setting may be in a photo mode.

In Table 1, the first external environmental condition and the secondexternal environmental condition may indicate different conditions forthe surrounding environment of the camera module 180. For example, thefirst external environmental condition may be a high illuminancecondition; the second external environmental condition may be a lowilluminance condition.

In Table 1, the operation of the image sensor may indicate which signalof the image sensor is read out by the image sensor, depending on theidentified camera operation settings and/or external environmentalconditions.

In Table 1, AF information may be information about auto focus, and maymean what AF information the image sensor forms and outputs to theprocessor 120, depending on the identified camera operation settingsand/or external environmental conditions.

In Table 1, the output signal may be a signal to be output by thedisplay device 160 of the electronic device, and may mean which outputsignal the image sensor forms and outputs to the processor 120,depending on the identified camera operation settings and/or externalenvironmental conditions.

Referring to Table 1, the image sensor may detect a first vertical areasignal, a second vertical area signal, a third vertical area signal, anda fourth vertical area signal, and may generate and output first AFinformation, second AF information, and a first output signal, based onthe first camera operation setting and the first external environmentalcondition. Hereinafter, the vertical area signal, AF information, andoutput signal will be described in detail with reference to FIGS. 7 and8 .

Referring to FIGS. 7 and 8 , the image sensor 300 includes the syntheticsignal forming unit 701, the disparity calculation unit 702, and theremosaic processing unit 703. The synthetic signal forming unit 701, thedisparity calculation unit 702, and the remosaic processing unit 703 ofFIG. 7 are illustrated as a block diagram of pieces of hardware includedin the image sensor 300. However, the synthetic signal forming unit 701,the disparity calculation unit 702, and the remosaic processing unit 703may be implemented with software.

The image sensor 300 may detect the first vertical area signal, thesecond vertical area signal, the third vertical area signal, and thefourth vertical area signal, based on the first camera operation settingand the first external environmental condition

The image sensor 300 may detect a first vertical area signal 816, whichis a signal for light incident on a first photodiode 811 and a secondphotodiode 812 through a first micro-lens 815 of a first unit pixel 810,through a scan circuit and may transmit the first vertical area signal816 to the synthetic signal forming unit 701 of the image sensor 300,based on the first camera operation setting and the first externalenvironmental condition.

In the same manner, the image sensor 300 may transmit a third verticalarea signal 826, which is a signal for light incident on a fifthphotodiode 821 and a sixth photodiode 822 through a second micro-lens825 of a second unit pixel 820, to the synthetic signal forming unit 701based on the first camera operation setting mode and the first externalenvironmental condition.

In the same manner, the image sensor 300 may transmit a second verticalarea signal 817, which is a signal for light incident on a thirdphotodiode 813 and a fourth photodiode 814, to the synthetic signalforming unit 701 based on the first camera operation setting mode andthe first external environmental condition.

In the same manner, the image sensor 300 may transmit a fourth verticalarea signal 827, which is a signal for light incident on a seventhphotodiode 823 and an eighth photodiode 824, to the synthetic signalforming unit 701 based on the first camera operation setting mode andthe first external environmental condition.

In this way, the reason that the image sensor 300 does not detect thesignal of each of a first photodiode 811, a second photodiode 812, athird photodiode, a fourth photodiode, a fifth photodiode, and a sixthphotodiode, but detects the signal by grouping the photodiodes for eacharea, may be because the power consumption of an electronic device maybe excessive, when a screen is output in real time with a highresolution in a high luminous environment because a preview mode needsto output the screen in real time. Accordingly, the signal to bedetected by the image sensor may be reduced to ½ by detecting a signalby grouping photodiodes for each area, and thus this may be to reducethe power consumption.

The image sensor 300 may form first AF information and second AFinformation and may output the first AF information and the second AFinformation to a processor 120, based on the first camera operationsetting and the first external environmental condition.

The synthetic signal forming unit 701 of the image sensor 300 maysynthesize the received first vertical area signal 816 and the receivedthird vertical area signal 826 to form the first AF information.

The synthetic signal forming unit 701 of the image sensor 300 maysynthesize the received second vertical area signal 817 and the receivedfourth vertical area signal 827 to form the second AF information.

The image sensor 300 may output the formed first AF information and theformed second AF information to a processor 120.

The fact that the image sensor 300 may only output the first AFinformation and the second AF information, which are horizontal focusinformation, to the processor 120 may be to reduce the power consumptionof the electronic device by adjusting the focus only with horizontalfocus information without vertical focus information because it is easyto adjust the focus in a high luminous environment. Accordingly, theimage sensor outputting horizontal focus information to the processor isdescribed. However, the image sensor may also output only vertical focusinformation to the processor. The vertical focus information will bedescribed later.

The image sensor 300 may form a first output signal to output the firstoutput signal to a processor 120, based on the first camera operationsetting and the first external environmental condition. The image sensor300 may generate the first output signal that is a sum of the firstvertical area signal 816 and the second vertical area signal 817 of thefirst unit pixel 810, to output the first output signal to theprocessor, based on the first camera operation setting and the firstexternal environmental condition. The image sensor 300 may generate anoutput signal corresponding to the first output signal of each of theunit pixels included in a pixel array 332 to output the output signal tothe processor, based on the first camera operation setting and the firstexternal environmental condition.

The fact that the image sensor 300 may output a plurality of photodiodesincluded in a unit pixel as a single signal without processing thesignal of each of the plurality of photodiodes included in the unitpixel may be to reduce the power consumption of the electronic deviceeven though a resolution decreases because the resolution has lowimportance in a preview mode.

Returning to Table 1, the image sensor 300 may detect the first pixelsignal, the second pixel signal, the third pixel signal, and the fourthpixel signal per the first unit pixel 810; may detect the fifth pixelsignal, the sixth pixel signal, the seventh pixel signal, and the eighthpixel signal per the second unit pixel 820; and may generate and outputthe first AF information, the second AF information, the third AFinformation, the fourth AF information, and the second output signal,based on the first camera operation setting and the second externalenvironmental condition. Hereinafter, this will be described in detailwith reference to FIGS. 7 and 9 .

Referring to FIGS. 7 and 9 , the image sensor 300 may detect the firstpixel signal, the second pixel signal, the third pixel signal, and thefourth pixel signal per the first unit pixel 810 based on the firstcamera operation setting and the second external environmentalcondition. The first pixel signal may correspond to a signal for lightincident on the first photodiode 811. The second pixel signal maycorrespond to a signal for light incident on the second photodiode 812.The third pixel signal may correspond to a signal for light incident onthe third photodiode 813. The fourth pixel signal may correspond to asignal for light incident on the fourth photodiode 814.

The image sensor 300 may detect the detected first pixel signal, thedetected second pixel signal, the detected third pixel signal, and thedetected fourth pixel signal through a scan circuit to transmit thedetected first pixel signal, the detected second pixel signal, thedetected third pixel signal, and the detected fourth pixel signal to thesynthetic signal forming unit 701 of the image sensor 300.

The image sensor 300 may detect the fifth pixel signal, the sixth pixelsignal, the seventh pixel signal, and the eighth pixel signal per thesecond unit pixel 820 based on the first camera operation setting andthe second external environmental condition. The fifth pixel signal maycorrespond to a signal for light incident on the fifth photodiode 821.The sixth pixel signal may correspond to a signal for light incident onthe sixth photodiode 822. The seventh pixel signal may correspond to asignal for light incident on the seventh photodiode 823. The eighthpixel signal may correspond to a signal for light incident on the eighthphotodiode 824.

The image sensor 300 may detect the detected fifth pixel signal, thedetected sixth pixel signal, the detected seventh pixel signal, and thedetected eighth pixel signal through a scan circuit to transmit thedetected fifth pixel signal, the detected sixth pixel signal, thedetected seventh pixel signal, and the detected eighth pixel signal tothe synthetic signal forming unit 701 of the image sensor 300.

The image sensor 300 may form the first AF information, the second AFinformation, the third AF information, and the fourth AF information tooutput the first AF information, the second AF information, the third AFinformation, and the fourth AF information to a processor 120, based onthe first camera operation setting and the second external environmentalcondition.

The synthetic signal forming unit 701 of the image sensor 300 maysynthesize the received first pixel signal, the received second pixelsignal, the received fifth pixel signal, and the received sixth pixelsignal to form the first AF information.

The synthetic signal forming unit 701 of the image sensor 300 maysynthesize the received third pixel signal, the received fourth pixelsignal, the received seventh pixel signal, and the received eighth pixelsignal to form the second AF information.

The synthetic signal forming unit 701 of the image sensor 300 maysynthesize the received first pixel signal, the received third pixelsignal, the received fifth pixel signal, and the received seventh pixelsignal to form the third AF information.

The synthetic signal forming unit 701 of the image sensor 300 maysynthesize the received second pixel signal, the received fourth pixelsignal, the received sixth pixel signal, and the received eighth pixelsignal to form the fourth AF information.

The image sensor 300 may output the formed first AF information, theformed second AF information, the formed third AF information, and theformed fourth AF information to the processor 120.

The fact that the image sensor 300 may form all of the first AFinformation and the second AF information that are horizontal focusinformation, and the third AF information and the fourth AF informationthat are vertical focus information to output the first AF information,the second AF information, the third AF information, and the fourth AFinformation to the processor 120 may be to complement the vertical focusinformation and the horizontal focus information with each other toadjust a focus by using both the vertical focus information and thehorizontal focus information because it may be difficult to adjust thefocus in a low luminous environment.

The image sensor 300 may form a second output signal to output thesecond output signal to the processor 120, based on the first cameraoperation setting and the second external environmental condition. Theimage sensor 300 may generate the second output signal obtained bysumming the first pixel signal, the second pixel signal, the third pixelsignal, and the fourth pixel signal to output the summed result to theprocessor based on the first camera operation setting and the secondexternal environmental condition. The image sensor 300 may generate theoutput signal corresponding to the second output signal of each of theunit pixels included in a pixel array 332 based on the first cameraoperation setting and the second external environmental condition.

The reason that the image sensor 300 sums signals of a plurality ofphotodiodes included in a unit pixel to output the summed result as asingle signal (the second output signal) may be because the resolutionof the displayed screen has low importance in the preview mode.

Returning to Table 1, the image sensor 300 may detect the first pixelsignal, the second pixel signal, the third pixel signal, and the fourthpixel signal per the first unit pixel 810; may detect the fifth pixelsignal, the sixth pixel signal, the seventh pixel signal, and the eighthpixel signal per the second unit pixel 820; and may generate and outputthe first AF information, the second AF information, the third AFinformation, the fourth AF information, and the third output signal,based on the second camera operation setting and the first externalenvironmental condition. The description about the operation and AFinformation output of the image sensor 300 based on the second cameraoperation setting and the first external environmental condition may bethe same as that in the case of the first camera operation setting andthe second external environmental condition, and thus the descriptionwill be omitted. The third output signal may correspond to theBayer-patterned image. Hereinafter, the third output signal will bedescribed in detail with reference to FIGS. 7 and 9 .

Referring to FIGS. 7 and 9 , a pixel array 910 of the image sensor 300may include a plurality of photodiodes including a first photodiode 811,a second photodiode 812, a third photodiode 813, a fourth photodiode814, a fifth photodiode 821, a sixth photodiode 822, a seventhphotodiode 823, and an eighth photodiode 824. Additional photodiodes mayalso be included in the plurality of photodiodes. The image sensor 300may detect the first pixel signal, the second pixel signal, the thirdpixel signal, the fourth pixel signal, the fifth pixel signal, the sixthpixel signal, the seventh pixel signal, and the eighth pixel signal fromthe plurality of photodiodes including the first photodiode 811, thesecond photodiode 812, the third photodiode 813, the fourth photodiode814, the fifth photodiode 821, the sixth photodiode 822, the seventhphotodiode 823, and the eighth photodiode 824 based on the second cameraoperation setting and the first external environmental condition,respectively.

The remosaic processing unit 703 of the image sensor 300 may form aBayer-patterned image 920 by converting the detected first pixel signal,the detected second pixel signal, the detected third pixel signal, thedetected fourth pixel signal, the detected fifth pixel signal, thedetected sixth pixel signal, the detected seventh pixel signal, and thedetected eighth pixel signal.

The Bayer-patterned image may mean a pattern in which green (G) and eachof red (R) and blue (B) are intersected with each other such that green(G) is 50%, and each of red (R) and blue (B) are 25% depending on visualcharacteristics of a human. Additionally, it may be necessary to convertsignals detected by the image sensor into Bayer-patterned images whenthe image signal processor 260 performs image signal processing (ISP).

A process of converting signals (the first pixel signal, the secondpixel signal, the third pixel signal, the fourth pixel signal, the fifthpixel signal, the sixth pixel signal, the seventh pixel signal, and theeighth pixel signal) detected by the image sensor into theBayer-patterned image 920 may include a process such as rearranging,synthesizing, averaging, weighting, and adjusting contrast of an edgeportion of the signals detected by the image sensor 300. The algorithmapplied to the signals detected by the image sensor 300 to form theBayer-patterned image 920 may be referred to as a remosaic algorithm.The content of the remosaic algorithm may vary for each manufacturer ofan image sensor. The algorithm applied to the signals detected by theimage sensor to form an image may be collectively referred to as aremosaic algorithm.

The image sensor 300 may form a third output signal, which is theBayer-patterned image 920, to output the third output signal to aprocessor 120, based on the second camera operation setting and thefirst external environmental condition.

The reason that the image sensor 300 may detect the signal of each of aplurality of photodiodes included in a unit pixel to form and output aBayer-patterned image through processing may be because that maintaininga resolution may be more important than reducing a power consumption ofan electronic device, in a video mode. Returning to Table 1, the imagesensor 300 may detect a first vertical area signal, a second verticalarea signal, a third vertical area signal, and a fourth vertical areasignal, and may generate and output first AF information, second AFinformation, and a first output signal, based on the second cameraoperation setting and the second external environmental condition. Thedescription about the operation, AF information, and output signal ofthe image sensor 300 based on the second camera operation setting andthe second external environmental condition may be the same as that inthe case of the first camera operation setting and the first externalenvironmental condition, and thus the description will be omitted.

The fact that the image sensor 300 may detect the signal by grouping aplurality of photodiodes by area without detecting the signal of each ofthe plurality of photodiodes included in the unit pixel and output onlythe first AF information and the second AF information, which arehorizontal focus information, to a processor when the image sensor 300is in the second camera operation setting and the second externalenvironmental condition may be to reduce detection noise (read outnoise) by reducing the signal detected by the image sensor to complementthe quality of a video in low luminous environments because sufficientexposure time is not secured in low illuminance.

Returning to Table 1, the image sensor 300 may detect the first pixelsignal, the second pixel signal, the third pixel signal, and the fourthpixel signal per the first unit pixel 810; may detect the fifth pixelsignal, the sixth pixel signal, the seventh pixel signal, and the eighthpixel signal per the second unit pixel 820; and may generate and outputthe third output signal, based on the third camera operation setting andthe first external environmental condition. The description about theoperation and output signal of the image sensor 300 based on the thirdcamera operation setting and the first external environmental conditionmay be the same as that in the case of the second camera operationsetting and the first external environmental condition, and thus thedescription will be omitted.

The image sensor 300 may not generate AF information in the case of thethird camera operation setting and the first external environmentalcondition. This may be because there is no need to separately form AFinformation in a photo mode as long as the AF information formed in thepreview mode is used. Furthermore, the fact that the image sensor 300forms the third output signal (a Bayer-patterned image) when the imagesensor 300 is in the third camera operation setting and the firstexternal environmental condition may be to output a high-resolutionphoto in a high luminous environment. Returning to Table 1, the imagesensor 300 may detect the first unit pixel signal and the second unitpixel signal and may output the first unit pixel signal and the secondunit pixel signal, based on the third camera operation setting and thesecond external environmental condition.

When the image sensor 300 is in the third camera operation setting andthe second external environmental condition, the image sensor 300 maydetect the first unit pixel signal that is a signal corresponding to thefirst unit pixel 810. Besides, the image sensor 300 may detect thesecond unit pixel signal that is a signal corresponding to the secondunit pixel 820. The image sensor 300 may output the detected first unitpixel signal and the detected second unit pixel signal to a processor.The reason that the image sensor 300 groups and detects signals of aplurality of photodiodes included in a unit pixel in the third cameraoperation setting and the second external environmental condition may befocused on reducing the power consumption of an electronic devicebecause the resolution of photo may be meaningless in a low luminousenvironment.

The image sensor 300 may not generate AF information in the case of thethird camera operation setting and the second external environmentalcondition. This may be because there is no need to separately form AFinformation in a photo mode as long as the AF information formed in thepreview mode is used.

Hereinafter, the output signals of an image sensor will be describedwith reference to FIGS. 10 and 11 . The same configurations as those ofthe above-described embodiment may be referenced by the same referencenumerals, and description thereof may be omitted.

FIG. 10 is a diagram illustrating a first case 1010 and a second case1040 of outputting signals of an image sensor, according to anembodiment. FIG. 11 is a diagram 1100 illustrating a method ofcalculating a disparity of an image sensor, according to an embodiment.

Referring to FIG. 10 , the image sensor 300 outputs first output signals1011 or second output signals 1021 to a processor 120. The case wherethe image sensor 300 outputs the first output signals 1011 will bedescribed first. The first output signals 1011 may be signals foroutputting a single frame. In a case of the first camera operationsetting and the second external environmental condition or in a case ofthe second camera operation setting and the first external environmentalcondition, the first output signals 1011 may be signals that allow theimage sensor 300 to output a single frame.

The image sensor 300 may not transmit all pieces of horizontal focusinformation (horizontal Y) including partial signal 1013, partial signal1016, and partial signal 1019, and all pieces of vertical focusinformation (vertical Y) including partial signal 1014, partial signal1017, and partial signal 1020 after transmitting all image signalsincluding partial signal 1012, partial signal 1015, and partial signal1018 for a single frame, but alternately transmit signals, for example,a partial signal 1012 of image signals, a partial signal 1013 ofhorizontal focus information, a partial signal 1014 of vertical focusinformation, a partial signal 1015 of image signals, a partial signal1016 of horizontal focus information, and a partial signal 1017 ofvertical focus information. As described above, the horizontal focusinformation may include the first AF information and second AFinformation. In addition, the vertical focus information may include thethird AF information and the fourth AF information.

Each of the signals 1012 to 1020 for a single frame may be divided intoa virtual channel (VC) and data type (DT) of separate signalspecification (e.g., mobile industry processor interface (MIPI)) and maybe transmitted to the processor. Examples of VC and DT for each signalare shown in Table 2, below.

TABLE 2 Virtual Data channel type (VC) (DT) Image signals 0 0x12Horizontal focus 1 0x12 information (Horizontal Y) Vertical focus 2 0x12information (Vertical Y) Vertical disparity 3 0x12 information (Verticaldisparity)

In Table 2, vertical disparity information (Vertical disparity) will bedescribed later.

Hereinafter, the case where the image sensor 300 outputs the secondoutput signals 1021 is described. The second output signals 1021 may besignals for outputting a single frame. In the case of the first cameraoperation setting and the second external environmental condition or inthe case of the second camera operation setting and the first externalenvironmental condition, the second output signals 1021 may be signalsthat allow the image sensor 300 to output a single frame.

The image sensor 300 may alternately transmit signals, for example, apartial signal 1022 of image signals, a partial signal 1023 ofhorizontal focus information, a partial signal 1024 of verticaldisparity information (Vertical disparity), a partial signal 1025 ofimage signals, a partial signal 1026 of horizontal focus information,and a partial signal 1027 of vertical disparity information.

Hereinafter, disparity information will be described in detail withreference to FIGS. 10 and 11 . The same configurations as those of theabove-described embodiment may be referenced by the same referencenumerals, and description thereof may be omitted.

The image sensor 300 may form a left signal image 1120 by synthesizingthe first vertical area signal 816 and the third vertical area signal826. That is, the image sensor 300 may form the left signal image 1120based on the first AF information.

Moreover, the image sensor 230 may form a right signal image 1121 bysynthesizing the second vertical area signal 817 and the fourth verticalarea signal 827. That is, the image sensor 300 may form the right signalimage 1121 based on the second AF information.

The disparity calculation unit 702 of the image sensor 230 may calculatehorizontal disparity information (Horizontal disparity), which is thedisparity between the left signal image including partial signal 1013,partial signal 1016, or partial signal 1019 and the right signal imageincluding partial signal 1013, partial signal 1016, or partial signal1019. The horizontal disparity may be a distance between the center linec1 of the left signal image including partial signal 1013, partialsignal 1016, or partial signal 1019 and the center line c2 of the rightsignal image including partial signal 1013, partial signal 1016, orpartial signal 1019. As the horizontal disparity is greater, this maymean that the extent to which the image captured by the image sensor 300is out of focus is greater. When the center line c1 of the left signalimage including partial signal 1013, partial signal 1016, or partialsignal 1019 completely overlaps with the centerline c2 of the rightsignal image including partial signal 1013, partial signal 1016, orpartial signal 1019, the horizontal disparity 1130 is 0. This may meanthat the image sensor 300 is in the on-focus state. Identically, thedisparity calculation unit 702 of the image sensor 230 may calculatevertical disparity information (Vertical disparity) including partialsignal 1024, partial signal 1027, or partial signal 1030 that is thedisparity between the upper signal image including partial signal 1014,partial signal 1017, or partial signal 1020 and the lower signal imageincluding partial signal 1014, partial signal 1017, or partial signal1020.

Returning to FIG. 10 , the image sensor 300 may output verticaldisparity information (Vertical disparity) including partial signal1024, partial signal 1027, or partial signal 1030 to a processor insteadof vertical focus information (Vertical Y) including partial signal1014, partial signal 1017, or partial signal 1020.

Hereinafter, an embodiment in which a unit pixel included in a pixelarray of an image sensor includes a 3×3 array of photodiodes will bedescribed in detail with reference to FIG. 12 .

FIG. 12 is a diagram 1200 illustrating unit pixels included in a pixelarray of an image sensor, according to an embodiment. The operation ofthe image sensor is the same as in the above-described embodiment, andthus only the definition of the vertical area signal and AF informationin the case where a unit pixel includes a 3×3 array of photodiodes willbe described.

Referring to FIG. 12 , each of a plurality of unit pixels include 3×3photodiodes. For example, a first unit pixel 1210 includes a firstphotodiode 1211, a second photodiode 1212, a third photodiode 1213, afourth photodiode 1214, a fifth photodiode 1215, a sixth photodiode1216, a seventh photodiode 1217, an eight photodiode 1218, and a ninthphotodiode 1219 arranged to overlap with a first micro-lens 1231. Thedescription of the first unit pixel 1210 may also be applied to a secondunit pixel 1220.

The first vertical area signal of the first unit pixel 1210 may mean asignal detected in the first photodiode 1211, the second photodiode1212, the third photodiode 1213, the fourth photodiode 1214, the fifthphotodiode 1215, and the sixth photodiode 1216. The second vertical areaof the first unit pixel 1210 may include the fourth photodiode 1214, thefifth photodiode 1215, the sixth photodiode 1216, the seventh photodiode1217, the eighth photodiode 1218, and the ninth photodiode 1219.

The third vertical area of the second unit pixel 1220 may include atenth photodiode 1221, an eleventh photodiode 1222, a twelfth photodiode1223, the thirteenth photodiode 1224, the fourteenth photodiode 1225,and the fifteenth photodiode 1226. The fourth vertical area of thesecond unit pixel 1220 may include the thirteenth photodiode 1224, thefourteenth photodiode 1225, the fifteenth photodiode 1226, a sixteenthphotodiode 1227, a seventeenth photodiode 1228, and an eighteenthphotodiode 1229.

The first AF information may be formed based on the first vertical areasignal of the first unit pixel 1210 and the third vertical area signalof the second unit pixel 1220. The second AF information may be formedbased on the second vertical area signal of the first unit pixel 1210and the fourth vertical area signal of the second unit pixel 1220.

The unit pixel is not limited to 2×2 photodiodes or 3×3 photodiodes. Forexample, an image sensor may include n×n photodiodes per unit pixel.

According to an embodiment of the disclosure, an electronic device mayinclude an image sensor including a first unit pixel including a firstmicro-lens and a plurality of first photodiodes facing each other with afirst color filter interposed between the plurality of firstphotodiodes, and a second unit pixel including a second micro-lens and aplurality of second photodiodes facing each other with a second colorfilter interposed between the plurality of second photodiodes, a cameramodule including the image sensor, and a processor operatively connectedwith the image sensor. The first unit pixel may include a firstphotodiode, a second photodiode, a third photodiode, and a fourthphotodiode, which are disposed in a square shape such that a horizontalnumber of photodiodes is identical to a vertical number of photodiodes.The second unit pixel may include a fifth photodiode, a sixthphotodiode, a seventh photodiode, and an eighth photodiode, which aredisposed in a square shape such that a horizontal number of photodiodesis identical to a vertical number of photodiodes. The image sensor mayidentify an operation setting and an external environmental condition ofthe camera module, and, upon identifying that the operation setting is apreview mode and the external environmental condition is a high luminousenvironment, the image sensor may identify a first area signalcorresponding to a signal of the first photodiode and the secondphotodiode, which are concatenated with each other and included in thefirst unit pixel, and the image sensor may identify a second area signalthat corresponds to a signal of the fifth photodiode, included in thesecond unit pixel, corresponding to a location of the first photodiodeand the sixth photodiode, included in the second unit pixelcorresponding to a location of the second photodiode, and may form firstAF information based on the first area signal and the second areasignal.

Upon identifying that the operation setting is the preview mode and theexternal environmental condition is the high luminous environment, theimage sensor may identify a third area signal corresponding to a signalof the third photodiode and the fourth photodiode, which areconcatenated with each other and included in the first unit pixel, mayidentify a fourth area signal that corresponds to a signal of theseventh photodiode and the eighth photodiode in the second unit pixel,may form second AF information based on the third area signal and thefourth area signal, and may output the formed first AF information andthe formed second AF information to the processor.

The image sensor may output an image signal for a preview image to theprocessor, and the image signal may include a signal obtained bysynthesizing the first area signal and the second area signal, and asignal obtained by synthesizing the third area signal and the fourtharea signal.

Upon identifying that the operation setting is the preview mode and theexternal environmental condition is a low luminous environment, theimage sensor may form the first AF information based on a first pixelsignal of the first photodiode, a second pixel signal of the secondphotodiode, a fifth pixel signal of the fifth photodiode, and a sixthpixel signal of the sixth photodiode; may form second AF informationbased on a third pixel signal of the third photodiode, a fourth pixelsignal of the fourth photodiode, a seventh pixel signal of the seventhphotodiode, and an eighth pixel signal of the eighth photodiode; mayform third AF information based on the first pixel signal of the firstphotodiode, the third pixel signal of the third photodiode, the fifthpixel signal of the fifth photodiode, and the seventh pixel signal ofthe seventh photodiode; may form fourth AF information based on thesecond pixel signal of the second photodiode, the fourth pixel signal ofthe fourth photodiode, the sixth pixel signal of the sixth photodiode,and the eighth pixel signal of the eighth photodiode; may output theformed first AF information and the formed second AF information to theprocessor; and may output the formed third AF information and the formedfourth AF information to the processor.

The image sensor outputs an image signal for a preview image to theprocessor, and the image signal may include a signal obtained bysynthesizing the first pixel signal, the second pixel signal, the thirdpixel signal, and the fourth pixel signal, and a signal obtained bysynthesizing the fifth pixel signal, the sixth pixel signal, the seventhpixel signal, and the eighth pixel signal.

Upon identifying that the operation setting is a video mode and theexternal environmental condition is the high luminous environment, theimage sensor may identify a first pixel signal of the first photodiode,a second pixel signal of the second photodiode, a third pixel signal ofthe third photodiode, a fourth pixel signal of the fourth photodiode, afifth pixel signal of the fifth photodiode, a sixth pixel signal of thesixth photodiode, a seventh pixel signal of the seventh photodiode, andan eighth pixel signal of the eighth photodiode; may form aBayer-patterned image by applying a remosaic algorithm to the firstpixel signal, the second pixel signal, the third pixel signal, thefourth pixel signal, the fifth pixel signal, the sixth pixel signal, theseventh pixel signal, and the eighth pixel signal; and may output theBayer-patterned image as an image signal to the processor.

The image sensor may form the first AF information based on the firstpixel signal, the second pixel signal, the fifth pixel signal and thesixth pixel signal; may form second AF information based on the thirdpixel signal, the fourth pixel signal, the seventh pixel signal and theeighth pixel signal; may form third AF information based on the firstpixel signal, the third pixel signal, the fifth pixel signal and theseventh pixel signal; may form fourth AF information based on the secondpixel signal, the fourth pixel signal, the sixth pixel signal and theeighth pixel signal; may output the formed first AF information and theformed second AF information to the processor; and may output the formedthird AF information and the formed fourth AF information to theprocessor.

Upon identifying that the operation setting is a video mode and theexternal environmental condition is a low luminous environment, theimage sensor may identify the first area signal corresponding to thesignal of the first photodiode and the second photodiode, may identifythe second area signal corresponding to the signal of the fifthphotodiode and the sixth photodiode, may form the first AF informationbased on the first area signal and the second area signal, may identifya third area signal corresponding to a signal of the third photodiodeand the fourth photodiode, may identify a fourth area signal thatcorresponds to a signal of the seventh photodiode and the eighthphotodiode, may form second AF information based on the third areasignal and the fourth area signal, and may output the formed first AFinformation and the formed second AF information to the processor.

The image sensor may output an image signal for a video captured withthe camera module, to the processor, and the image signal may include asignal obtained by synthesizing the first area signal and the secondarea signal, and a signal obtained by synthesizing the third area signaland the fourth area signal.

Upon identifying that the operation setting is a photo mode and theexternal environmental condition is a high luminous environment, theimage sensor may identify a first pixel signal of the first photodiode,a second pixel signal of the second photodiode, a third pixel signal ofthe third photodiode, a fourth pixel signal of the fourth photodiode, afifth pixel signal of the fifth photodiode, a sixth pixel signal of thesixth photodiode, a seventh pixel signal of the seventh photodiode, andan eighth pixel signal of the eighth photodiode; may form aBayer-patterned image by applying a remosaic algorithm to the firstpixel signal, the second pixel signal, the third pixel signal, thefourth pixel signal, the fifth pixel signal, the sixth pixel signal, theseventh pixel signal, and the eighth pixel signal; and may output theBayer-patterned image as an image signal to the processor.

Upon identifying the operation settings is a photo mode and the externalenvironmental condition is a low luminous environment, the image sensormay identify a first unit pixel signal that is a signal of the firstphotodiode, the second photodiode, the third photodiode and the fourthphotodiode; may identify a second unit pixel signal that is a signal ofthe fifth photodiode, the sixth photodiode, the seventh photodiode andthe eighth photodiode; and may output an image signal including thefirst unit pixel signal and the second unit pixel signal to theprocessor.

According to an embodiment of the disclosure, an operating method of anelectronic device including an image sensor including a first unit pixelincluding a first micro-lens and a plurality of photodiodes disposed ina square shape such that a horizontal number of photodiodes is identicalto a vertical number of photodiodes, and a second unit pixel including asecond micro-lens and a plurality of photodiodes, which face each otherand are disposed in a square shape such that a horizontal number ofphotodiodes is identical to a vertical number of photodiodes, a cameramodule including the image sensor, and a processor operatively connectedwith the image sensor may include identifying, by the image sensor, anoperation setting and an external environmental condition of the cameramodule, upon identifying that the operation setting is a preview modeand the external environmental condition is a high luminous environment,or upon identifying that the operation setting is a video mode and theexternal environmental condition is a low luminous environment,identifying a first area signal corresponding to a signal of a firstphotodiode and a second photodiode, which are concatenated with eachother and which are included in the first unit pixel, identifying asecond area signal corresponding to a signal of a fifth photodiodecorresponding to a location of the first photodiode, and a sixthphotodiode corresponding to a location of the second photodiode, whereinthe fifth photodiode and the sixth photodiode are included in the secondunit pixel, and forming first AF information based on the first areasignal and the second area signal.

Upon identifying that the operation setting is the preview mode and theexternal environmental condition is the high luminous environment, orupon identifying that the operation setting is the video mode and theexternal environmental condition is the low luminous environment, themethod may further include identifying, by the image sensor, a thirdarea signal corresponding to a signal of a third photodiode and a fourthphotodiode, which are concatenated with each other and which areincluded in the first unit pixel, identifying, by the image sensor, afourth area signal corresponding to a signal of a seventh photodiode andan eighth photodiode, which are included in the second unit pixel,forming, by the image sensor, second AF information based on the thirdarea signal and the fourth area signal, and outputting, by the imagesensor, the formed first AF information and the formed second AFinformation to the processor.

The method may further include outputting, by the image sensor, an imagesignal for a preview image to the processor. The image signal mayinclude a signal obtained by synthesizing the first area signal and thesecond area signal, and a signal obtained by synthesizing a third areasignal and a fourth area signal.

Upon identifying that the operation setting is the preview mode and theexternal environmental condition is the low luminous environment, orupon identifying that the operation setting is the video mode and theexternal environmental condition is the high luminous environment, themethod may further include forming the first AF information based on afirst pixel signal of the first photodiode, a second pixel signal of thesecond photodiode, a fifth pixel signal of the fifth photodiode, and asixth pixel signal of the sixth photodiode; forming second AFinformation based on a third pixel signal of a third photodiode, afourth pixel signal of a fourth photodiode, a seventh pixel signal of aseventh photodiode, and an eighth pixel signal of an eighth photodiode;forming third AF information based on the first pixel signal of thefirst photodiode, the third pixel signal of the third photodiode, thefifth pixel signal of the fifth photodiode, and the seventh pixel signalof the seventh photodiode; forming fourth AF information based on thesecond pixel signal of the second photodiode, the fourth pixel signal ofthe fourth photodiode, the sixth pixel signal of the sixth photodiode,and the eighth pixel signal of the eighth photodiode; outputting theformed first AF information and the formed second AF information to theprocessor; and outputting the formed third AF information and the formedfourth AF information to the processor.

Upon identifying that the operation setting is the preview mode and theexternal environmental condition is the low luminous environment, theimage sensor may output an image signal for a preview image to theprocessor. The image signal may include a signal obtained bysynthesizing the first pixel signal, the second pixel signal, the thirdpixel signal, and the fourth pixel signal, and a signal obtained bysynthesizing the fifth pixel signal, the sixth pixel signal, the seventhpixel signal, and the eighth pixel signal.

Upon identifying that the operation setting is the video mode and theexternal environmental condition is the high luminous environment, themethod may further include forming a Bayer-patterned image by applying aremosaic algorithm to the first pixel signal, the second pixel signal,the third pixel signal, the fourth pixel signal, the fifth pixel signal,the sixth pixel signal, the seventh pixel signal, and the eighth pixelsignal, and outputting the Bayer-patterned image as an image signal tothe processor.

Upon identifying that the operation setting is a photo mode and theexternal environmental condition is the high luminous environment, themethod may further include identifying a first pixel signal of the firstphotodiode, a second pixel signal of the second photodiode, a thirdpixel signal of a third photodiode, a fourth pixel signal of a fourthphotodiode, a fifth pixel signal of the fifth photodiode, a sixth pixelsignal of the sixth photodiode, a seventh pixel signal of a seventhphotodiode, and an eighth pixel signal of an eighth photodiode; forminga Bayer-patterned image by applying a remosaic algorithm to the firstpixel signal, the second pixel signal, the third pixel signal, thefourth pixel signal, the fifth pixel signal, the sixth pixel signal, theseventh pixel signal, and the eighth pixel signal; and outputting theBayer-patterned image as an image signal to the processor.

Upon identifying that the operation setting is a photo mode and theexternal environmental condition is the low luminous environment, themethod may further include identifying a first unit pixel signal that isa signal of the first photodiode, the second photodiode, a thirdphotodiode and a fourth photodiode; identifying a second unit pixelsignal that is a signal of the fifth photodiode, the sixth photodiode, aseventh photodiode and an eighth photodiode; and outputting an imagesignal including the first unit pixel signal and the second unit pixelsignal to the processor.

It should be understood that various embodiments of the disclosure andterms used in the embodiments do not intend to limit technical featuresto the particular embodiment disclosed herein; rather, the disclosureshould be construed to cover various modifications, equivalents, oralternatives of embodiments of the disclosure. With regard todescription of drawings, similar or related components may be assignedwith similar reference numerals. As used herein, singular forms of wordscorresponding to an item may include one or more items unless thecontext clearly indicates otherwise. In the disclosure, each of theexpressions “A or B”, “at least one of A and B”, “at least one of A orB”, “A, B, or C”, “one or more of A, B, and C”, or “one or more of A, B,or C”, may include any and all combinations of one or more of theassociated listed items. The expressions, such as “a first”, “a second”,“the first”, or “the second”, may be used merely for the purpose ofdistinguishing a component from the other components, but do not limitthe corresponding components in other aspect (e.g., the importance orthe order). It is to be understood that if an element (e.g., a firstelement) is referred to, with or without the term “operatively” or“communicatively”, as “coupled with,” “coupled to,” “connected with,” or“connected to” another element (e.g., a second element), it means thatthe element may be coupled with the other element directly (e.g.,wiredly), wirelessly, or via a third element.

The term “module” used in the disclosure may include a unit implementedin hardware, software, or firmware and may be interchangeably used withthe terms “logic”, “logical block”, “part” and “circuit”. The “module”may be a minimum unit of an integrated part or may be a part thereof.The “module” may be a minimum unit for performing one or more functionsor a part thereof. The “module” may include an application-specificintegrated circuit (ASIC).

Various embodiments of the disclosure may be implemented by software(e.g., the program 140) including an instruction stored in amachine-readable storage medium (e.g., an internal memory 136 or anexternal memory 138) readable by a machine (e.g., the electronic device101). For example, the processor (e.g., the processor 120) of a machine(e.g., the electronic device 101) may call the instruction from themachine-readable storage medium and execute the instructions thuscalled. This means that the machine may perform at least one functionbased on the called at least one instruction. The one or moreinstructions may include a code generated by a compiler or executable byan interpreter. The machine-readable storage medium may be provided inthe form of non-transitory storage medium. Here, the term“non-transitory”, as used herein, means that the storage medium istangible, but does not include a signal (e.g., an electromagnetic wave).The term “non-transitory” does not differentiate a case where the datais permanently stored in the storage medium from a case where the datais temporally stored in the storage medium.

The method according to various embodiments disclosed in the disclosuremay be provided as a part of a computer program product. The computerprogram product may be traded between a seller and a buyer as a product.The computer program product may be distributed in the form ofmachine-readable storage medium (e.g., a compact disc read only memory(CD-ROM)) or may be directly distributed (e.g., download or upload)online through an application store (e.g., a Play Store™) or between twouser devices (e.g., the smartphones). In the case of onlinedistribution, at least a portion of the computer program product may betemporarily stored or generated in a machine-readable storage mediumsuch as a memory of a manufacturer's server, an application store'sserver, or a relay server.

Each component (e.g., the module or the program) of the above-describedcomponents may include one or plural entities. According to variousembodiments, at least one or more components of the above components oroperations may be omitted, or one or more components or operations maybe added. Additionally or alternatively, some components (e.g., themodule or the program) may be integrated in one component. In this case,the integrated component may perform the same or similar functionsperformed by each corresponding components prior to the integration.According to various embodiments, operations performed by a module, aprogramming, or other components may be executed sequentially, inparallel, repeatedly, or in a heuristic method, or at least someoperations may be executed in different sequences, omitted, or otheroperations may be added.

According to embodiments disclosed in this specification, it is possibleto implement a high-resolution image by applying AF informationdifferently and the output of an image sensor depending on cameraoperation settings and external environmental conditions.

Besides, a variety of effects directly or indirectly understood throughthe specification may be provided.

While the present disclosure has been particularly shown and describedwith reference to certain embodiments thereof, it will be understood bythose of ordinary skill in the art that various changes in form anddetails may be made therein without departing from the spirit and scopeof the disclosure as defined by the appended claims and theirequivalents.

What is claimed is:
 1. An electronic device comprising: an image sensorincluding a plurality of unit pixels including a first unit pixel and asecond unit pixel, the first unit pixel including a first micro-lens, afirst color filter disposed under the first micro-lens, and a firstphotodiode-array disposed under the first color filter and including aplurality of photodiodes arranged in a same number of columns and rowsas each other, and the second unit pixel including a second micro-lens,a second color filter disposed under the second micro-lens and having adifferent color from that of the first color filter, and a secondphotodiode-array disposed under the second color filter and including aplurality of photodiodes arranged in a same number of columns and rowsas each other; and a processor operatively coupled with the imagesensor, wherein the processor is configured to: identify a modecorresponding to an auto-focus function; if the mode is identified as afirst mode, perform the auto-focus function based at least in part oncomparing a first combined signal generated by combining signalsobtained from a first column of the first photodiode-array with a secondcombined signal generated by combining signals obtained from a secondcolumn of the first photodiode-array; if the mode is identified as asecond mode different from the first mode, perform the auto-focusfunction based at least in part on comparing the first combined signalwith the second combined signal and comparing a third combined signalgenerated by combining signals obtained from a first row of the firstphotodiode-array with a fourth combined signal generated by combiningsignals obtained from a second row of the first photodiode-array; andgenerate an image signal based at least in part on signals obtained fromthe first unit pixel and the second unit pixel while the auto-focusfunction is performed according to a one of the first mode and thesecond mode.
 2. The electronic device of claim 1, wherein the processoris further configured to: identify a luminance level corresponding to anexternal environment of the electronic device; if the luminance levelfalls into a first range, set the photographing function with the firstmode; and if the luminance level falls into a second range lower thanthe first range, set the photographing function with the second mode. 3.The electronic device of claim 2, wherein the processor is configuredto: perform the identifying of the luminance level using one or moresignals obtained via a luminance sensor external to the image sensor. 4.The electronic device of claim 1, wherein the processor is furtherconfigured to: provide, via a display, a live-preview corresponding toone or more external objects while the auto-focus function is setaccording to the first mode; and based on receiving a capture signal,capture a photograph image corresponding to the external objects whilethe auto-focus function is set according to the second mode.
 5. Theelectronic device of claim 1, wherein the processor is furtherconfigured to: perform a remosaic between the first unit pixel and thesecond unit pixel to generate the image signal.
 6. The electronic deviceof claim 1, wherein the processor is further configured to: identify anoperation mode for shooting; when the operation mode is a live-previewmode: generate a first synthesizing signal obtained by synthesizing thefirst unit pixel, generate a second synthesizing signal obtained bysynthesizing the second unit pixel, and generate the image signal forthe preview image based on the first synthesizing signal and the secondsynthesizing signal.
 7. The electronic device of claim 6, wherein theprocessor is further configured to: when the operation mode is a videomode or a photograph mode, identify a luminance level corresponding toan external environment of the electronic device.
 8. The electronicdevice of claim 7, wherein the processor is further configured to: ifthe luminance level falls into a first range, perform a remosaic betweenthe first unit pixel and the second unit pixel to generate the imagesignal.
 9. The electronic device of claim 8, wherein the processor isfurther configured to: if the luminance level falls into a second rangelower than the first range, generate the image signal for the previewimage based on the first synthesizing signal and the second synthesizingsignal.
 10. The electronic device of claim 8, wherein the processor isfurther configured to: generate a Bayer-patterned image by performingthe remosaic to the first unit pixel and the second unit pixel.
 11. Anelectronic device comprising: a memory; a display; a camera moduleincluding an image sensor, the image sensor including a plurality ofunit pixels including a first unit pixel and a second unit pixel, thefirst unit pixel including a first micro-lens, a first color filterdisposed under the first micro-lens, and a first photodiode-arraydisposed under the first color filter and including a plurality ofphotodiodes arranged in a same number of columns and rows as each other,and the second unit pixel including a second micro-lens, a second colorfilter disposed under the second micro-lens and having a different colorfrom that of the first color filter, and a second photodiode-arraydisposed under the second color filter and including a plurality ofphotodiodes arranged in a same number of columns and rows as each other;and a processor operatively coupled with the image sensor, wherein theprocessor is configured to: identify a mode corresponding to anauto-focus function for the camera module; if the mode is identified asa first mode, perform the auto-focus function based at least in part oncomparing a first combined signal generated by combining signalsobtained a first column of the first photodiode-array with a secondcombined signal generated by combining signals obtained from a secondcolumn of the first photodiode-array; if the mode is identified as asecond mode different from the first mode, perform the auto-focusfunction based at least in part on comparing the first combined signalwith the second combined signal and comparing a third combined signalgenerated by combining signals obtained from a first row of the firstphotodiode-array with a fourth combined signal generated by combiningsignals obtained from a second row of the first photodiode-array; anddisplay, via the display, an image generated based at least in part onsignals obtained from the first unit pixel and the second unit pixelwhile the auto-focus function is performed according to a one of thefirst mode and the second mode.
 12. The electronic device of claim 11,wherein the processor is further configured to: identify a luminancelevel corresponding to an external environment of the electronic device;if the luminance level falls into a first range, set the photographingfunction with the first mode; and if the luminance level falls into asecond range lower than the first range, set the photographing functionwith the second mode.
 13. The electronic device of claim 12, wherein theprocessor is further configured to: perform the identifying of theluminance level using one or more signals obtained via a luminancesensor external to the image sensor.
 14. The electronic device of claim11, wherein the processor is further configured to: provide, via adisplay, a live-preview corresponding to one or more external objectswhile the auto-focus function is set according to the first mode; andbased on receiving a capture signal, capture a photograph imagecorresponding to the external objects while the auto-focus function isset according to the second mode.
 15. The electronic device of claim 11,wherein the processor is further configured to: perform a remosaicbetween the first unit pixel and the second unit pixel to generate theimage signal.
 16. The electronic device of claim 11, wherein theprocessor is further configured to: identify an operation mode forshooting; when the operation mode is a live-preview mode: generate afirst synthesizing signal obtained by synthesizing the first unit pixel,generate a second synthesizing signal obtained by synthesizing thesecond unit pixel, and generate the image signal for the preview imagebased on the first synthesizing signal and the second synthesizingsignal.
 17. The electronic device of claim 16, wherein the processor isfurther configured to: when the operation mode is a video mode or aphotograph mode, identify a luminance level corresponding to an externalenvironment of the electronic device.
 18. The electronic device of claim17, wherein the processor is further configured to: if the luminancelevel falls into a first range, perform a remosaic between the firstunit pixel and the second unit pixel to generate the image signal. 19.The electronic device of claim 18, wherein the processor is furtherconfigured to: if the luminance level falls into a second range lowerthan the first range, generate the image signal for the preview imagebased on the first synthesizing signal and the second synthesizingsignal.
 20. The electronic device of claim 18, wherein the processor isfurther configured to: generate a Bayer-patterned image by performingthe remosaic to the first unit pixel and the second unit pixel.